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(54) TlUe: METHOD AND SYSTEM FOR MEASURING OBJECT FEATURES 
(57) Abstract 



A system is provided that simultaneously gathen 
chree-dimensionai and two-dimensional data for use in 
inspecting objects such as chip carrien iar defects. 
I Specifically, a source laser beam (303) is directed to an 
object and fomis a spot (305) at the point of impingement 
at a known X-Y position on the object The laser 
beam is reflected at the spot and light reflected off- 
axially (306, 307) with respect to the source laser beam 
(303) is detected by two position sensing detecton 
(PSDs) (310, 31 1), Simultaneous to detecting ofT-axially 
reflected light, retro-refected light (t.e., the light reflected 
approximately co-axlal widi the source laser) is detected 
> by a photo diode amy (313). Three dimensional objea 
information is determined from the position sensing 
I detector (310. 311) signals and two-dimensional object 
information is determined from the photo diode array 
(313) signal. 
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One typical way of measuring the dimensions of contacts 
or leads on chip carriers is through the use of a three 
dimensional (3-D) vision system that employs optical 
triangulation techniques. U.S. Patent No. 5,465,252 
5 issued to Bilodeau et al. (the "'152 patent"), expressly 
incorporated herein by reference, describes one such 
system. A light source such as a laser is positioned to 
illuminate an object (such as a packaged semiconductor 
chip) at a specific X-Y position. The source laser beam 
10 is directed through an optical system and forms a focused 
spot az the point of impingement on the object. The 
focused spot is reflected and light reflected off-axialiy 
with respect to the source laser beam is focussed on a 
light sensor. The image location (i.e., che point where 
15 the reflected spot impinges the light sensor) is related, 
using standard optics principals, co the location of the 
light spot on the object, which, in turn, can be used to 
determine image height (Z location) . Calibrated 
processing electronics are used co calculate the height 
20 of the object and score the object height with its 
associated X-Y location. The light source is then 
positioned to different X-Y locations, and the process is 
repeaced until 3-D data is gathered for che entire object, 
(or a porcion thereof) . The stored data is then be 
25 compared to a manufacturer's specification for the object 
(or portion thereof) to determine whether the object is 
defective , 



Known 3-D vision systems, such as the system described 
above, provide accurate results for measuring the 
dimensions of leads on chip carriers, and for coplanarity 
inspection of BGAs . However, there is difficulty in 
obtaining accurate dimensions (such as diameters) of 
ball, bump, and hemispherically shaped contacts, such as 
those found on certain chip carriers (e.g., BGAs). This 
difficulty is largely due co "shadow" effects. Known 3-D 
vision systems cannot accurately capture data concerning 
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exemplary embodiment, a system is provided that 
simultaneously collects three-dimensional and two- 
dimensional data for use in inspecting objects such as 
chip carriers for defects. Specifically, a source laser 
beam is directed to an object and forms a spot at the 
point of impingement at a known X-Y posicion on the 
object. The laser beam is reflected at the spot and the 
light reflected off-axially with respect to the source 
laser beam is detected by two position sensing detectors 
(PSDs) , 

Simultaneous to detecting off-axiaily reflected light, 
retro-reflected light (i.e., the liqhr reflected 
approximately co-axial with the source laser) is detected 
by a photo diode array. In this manner, visibility is 
obtained to the entire upper hemisphere of features such 
solder balls and bumps. 

Analog signals generated by the PSDs related to the 
position (s) where the reflected light impinged the PSDs, 
are used to calculate the Z coordinate o? the object 
(i.e., the height) at the point o£ impingement of the 
source laser beam on the object. This value is 
calculated using standard optical t riangulat ion 
principals. The three-dimensional (3-D) information can 
then be compared to manufacturer's specifications for the 
chip carrier to determine if, for example, each solder 
ball or bump on a chip carrier such as a ball grid array, 
is the correct height. Additionally, the information can 
be used for determining coplanarity. 

The amplitude of the reflected light that is received by 
each PSD at the known X-Y positions may be used to form 
an image of the reflected energy on a point by point 
basis. However, the resulting images (one per PSD) will 
suffer from the same shadowing effects as the three 
dimensional data that is simultaneously gathered. 
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description of exemplary embodiments taken in conjunction 
with the attached drawings wherein: 

Fig. 1 is a diagram of a prior art vision system; 
5 Fig. 2 is an illustration of "shadow" effects; 

Fig. 3 is a diagram of a first exemplary embodiment of 
the present invention; 

Fig. 4 is a flowchart illustrating the categorization of 
each collected intensity value in the 2-D array; 
10 Fig. 5 is the 2-D image of a solder ball as categorized 
by the process of Fig. 4; 

Fig. 6 is a flowchart of the determinacion of a threshold 
intensity value; 

Fig. 7 is a histogram of a 2-D image of a exemplary 
15 solder ball on a BGA; 

Fig. 8 is a flowchart of the analysis of the 2-D 
categorized data; 

Fig. 9 illustrates the projection of a 2-D image once the 
X and Y axes; 

20 Fig. 10 is a flowchart of the analysis of the 3-D data; 
Fig. il is a block diagram of a second representative 
embodiment of the present invention; and 

Fig. 12 is a block diagram showing further details of the 
optical system of Fig. 11. 



Detailed Description 

Prior Art Vision System: Referring now to the drawings, 
30 and initially Fig. 1, there is illustrated a typical 

prior art vision system. A source of light, i.e., laser 
101, is positioned to illuminate an object such as a chio 
carrier 102. A laser beam 103 from laser 101 is directed 
chrough an optical system 104 and forms a focused spot 
35 105 at the point of impingement on the chip carrier 102 
at a known X-Y position. The laser beam 103 focussed at 
spot 105 is reflected. The light reflected off-axially 
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measured, but it can be determined using complex fitting 
techniques. However, the accuracy of the results 
obtained may be less than the required accuracy. 

Exen5)lary Embodiment: Fig. 3 is a diagram of an 
exemplary embodiment of the present invention which 
overcomes many of the problems found in the prior art. 
A source of light, laser 301 (e.g., a gas laser, or a 
laser diode and collimator), is positioned to illuminate 
an object such as a chip carrier 302. A laser beam 303 
from laser 301 is directed through a beam splitter 305a 
and is focussed through an optical .system 304 to form a 
focused spot 305 at the point of impingement on the chip 
carrier 302 at a known X-Y position. (It will be 
understood by those of ordinary skill that the light may, 
instead, be Eocussed or deflected as a slit, plane of 
light, or other shape.) The laser beam 303 is reflected 
by the chip carrier 302 at spot 305. The light reflected 
off-axially with respect to source laser beam 303 (306, 
307) is focussed through two optical systems 308 and 309 
on two photo sensitive devices such as, for example, PSDs 
310 and 311. (It should be noted that other photo 
sensitive devices can also be used such as, for example, 
charge coupled devices (CCDs), or photo diode arrays.) 
The height (Z-location) at the X-Y position of the object 
(at the point of impingement of the source laser beam) is 
then calculated as was described in connection with Fig. 
1. Accordingly, 3-D data (i.e., X, Y, and 2 coordinates) 
is obtained, providing a 3-D image of the object at that 
X-Y location of the object. It will be understood by 
those of ordinary skill that the 3-D data can be obtained 
by detecting light reflected (off-axially with respect to 
the source laser beam) along a single path (and, 
accordingly, using a single photo sensitive device) 
rather than along two paths as described above. 
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are first initialized to refer to the first X-Y intensity 
value (step 401). Intensity value Y(i,j) is compared to 
a threshold intensity value T (step 402) (the 
determination of the threshold value is described below 
5 in connection with Fig. 6). If Y(i,j) has an intensity 
value that is greater than the threshold value T, then 
Y{i,j) is designated "background" (i.e., it is either the 
center of the ball/bump or the area surrounding the 
ball /bump) , thus l{i,j) (wherein l(i,j) denotes the label 
0 of Y(i,j)) is set to 0 (step 403). If, however, Y(i,j) 
has an intensity value that is less threshold value 
Chen Y(i,j) is an edge point of the ball/bump and Ki^jJ 
is set to 1 (step 404). This process is repeated until 
all of the intensity values in the 2-D array have been 
5 compared to the threshold value T (see steps 405. 406) . 
For solder balls and bumps, a typical result is a ring 
shaped image as shown in Fig. 5. 

Determination of a Threshold Intensity Value: In the 

representative embodiment of the present invention, the 
threshold value is determined using a fast, iterative 
procedure as shown in the flowchart of Fig. 6, First, a 
portion of a sample chip carrier, for example, a portion 
including a solder ball, is imaged using the system 
described in connection with Fig, 3 (step 601) . In the 
representative embodiment, only the 2-D data collected 
from the photo diode array 313 is utilized in the 
threshold value determination. Thus the 3-D data 
collected from PSDs 310 and 311 need not be stored. 

Next, the cluster center M (i.e., the mass center) of the 
data is determined (step 602) . In particular: 
M = l/N * E Y(i, j) , 

where N is the total number of data samples 
(i.e., an averaging function). M is then split into two 
new cluster centers, i.e., MO = M + p and Ml = M - p 
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{step 802) . Additionally, the X center position is 
calculated (step 803), i.e., X center = XI + (X2 - Xl)/2. 

Next, the 2-D image is projected onto the Y-axis (step 
804) . Y positional information and the Y diameter of 
each ball is determined based on this projection, i.e., Y 
diameter = Y2 - Yl (where Yl and Y2 are the minimum and 
maximum Y coordinates of the projected image) (step 805) . 
The Y center position is then calculated (step 806), 
i.e., Y center = Yl + (Y2 -Yl)/2. 

The combination of the two center coordinates, i.e., X 
center and Y center, defines the ball center coordinates 
(step 807), i.e., bail center = (X center, Y center). 

It will be understood by those of ordinary skill that the 
order of the steps illustrated in the flowchart of Fig. 8 
is merely exemplary. Many of the steps could be done in 
a different order. 

Fig. 9 illustrates the projection of the 2-D image onto 
the X and Y axes. Specifically, image 901 is shown 
projected onto the X axis 902, and the Y axis 903. 

Analysis of the 3-D Data: In the representative 
embodiment of the present invention, the 3-D data is 
analyzed to determine i) the height of each solder ball; 
and ii) chip carrier coplanarity. In accordance with the 
flowchart of Fig. 10, the data collected from PSDs 310 
and 311 is used to determine the height of each solder 
ball in accordance with well-)cnown optical t riangulat ion 
techniques (step 1001) . As is understood by those of 
ordinary s)<ilL, the point where a reflected spot impinges 
the PSDs 310 and 311 is related to the location of the 
light spot on the object, which, in turn, can be used to 
determine image height (Z location) . The respective 
image heights can then be compared to each other in order 
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Data collected by the opcical system 1101 is transmitted 
as an analog signal to the process electronics 1105. The 
process electronics 1105, which includes, for example, 
digital signal processors (DSPs), digital to analog (D/A) 
converters, analog to digital (A/D) converters, and 
input/output (I/O) and communication links, receives and 
processes the analog data. The processed data is then 
transmitted to the computer 1104 for analysis. The 
results of the analysis are reported to an operator on 
output device 1106. 

Fig. 12 shows the optical portion of the system of Fig. 
11 in more detail. A light source 1201 (for example, an 
830nm diode laser) controlled by process electronics 
1105, is positioned by gantry 1102 to illuminate an 
object such as a chip carrier 1202. Light, e.g., a laser 
beam 1203, is directed to a deflector 1204 which 
selectively deflects the laser beam 1203. 

The deflector 1204, controlled by process electronics 
1105, includes, for example, an acousto-opt ic (A.O.) 
deflector. The laser beam 1203 can be quickly "swept" 
across a predetermined area of the chip carrier 1202 by 
continuously changing the drive frequency to the 'A.O. 
deflector and thereby continuously changing the 
deflection of the laser beam 1203. Accordingly, the 
motion mechanism of the gantry 1102, in combination with 
the deflector 1204, precisely determine the X-Y position 
(and quickly change the X-Y postion) on the object 1202 
that the laser beam 1203 will impinge upon. 

From the deflector 1204, the laser beam 1203 is directed 
to a polarizing beam splitter cube 1205 through an 
optical system 1206 (comprised of, for example, two 
plano-convex cylindrical lenses, /«60mm, and /=22.2mm, a 
lens, /=40mm, and a half wave plate). The beam splitter 
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to the surface of the page. Accordingly, beam splitter 
1205 reflects the retro-reflected light through an 
optical system 1216 (comprised of, for example, an 
achromatic lens, /=50mm) onto a photo diode array 1217, 
The analog signals generated by the photo diode array 
1217 related to the intensity of light impinging the 
photo diode array 1217 and the optional normalization 
photo diode 1219 intensity are transmitted to the process 
electronics 1105. 

The analog signals from the photo sensitive devices, 
i.e., PSDs 1214 and 1215, and photo diode arrays 1217 and 
1219 are processed and analyzed by process electronics 
1105 and computer 1104. In particular, the analog 
signals are converted to digital signals (via an A/D 
converter) . Z coordinates are determLned from the data 
received from the PSDs 1214 and 12 IS as described above. 
The data collected from photo diode array 1219 (i.e., 
representing the intensity of the source laser beam) is 
used to normalize the data collected by photo diode array 
1217 (in order to maintain the accuracy of the data in 
the event of fluctuating laser output; . The process 
electronics 1105 then assembles data from the photo diode 
arrays 1217 and 1219, the Z coordinates, and the X and Y 
positions into data packets and transmits the packets to 
the computer 1104. The computer 1104 receives the 
packets and performs the algorithms described in 
connection with Figs. 4-10. The computer 1104 also 
provides an interface to a user. 

As is clear from the foregoing, the present invention 
provides a means to determine quickly and accurately 
feature dimensions without the use of complex curve 
fitting algorithms. Furthermore, 3-D data and 2-D data 
are simultaneously collected. Accordingly, the object 
need only be scanned once to obtain all the information 
necessary to determine the feature dimensions. 
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WHAT IS CLAIMED IS: 



1 1. A method for determining at least two dimensions of 

2 an object comprising the steps of: 

3 a) illuminating at least a portion of the object 

4 with light transmitted by a light source along a first 

5 path; 

6 b) detecting light reflected along a second path 

7 spaced from the first path from the object at a first 

8 preselected position; 

9 c) forming a first image of the illuminated portion 

10 o£ the object as a function of the Light detected in step 

11 b) ; 

12 d) simultaneously with step b) , detecting light 

13 retrc-ref lected within the first path from the object at 

14 a second preselected position; 

15 e) forming a second image of the illuminated portion 

16 of the object as a function of the light detected in step 

17 d; 

18 f) determining at least one first dimension of the 

19 object as a function of the first image; and 

20 g) determining at least one second dimension of the 

21 object as a function of the second image. 

1 2. The method of claim 1 wherein step a) further 

2 comprises: 

3 illuminating the at least a portion of the object at 

4 a predetermined X-Y coordinate. 

1 3. The method of claim 2 wherein the at least one first 

2 dimension is a Z coordinate of the object, 

1 4. The method of claim 2 wherein the at least one first 

2 dimension is a plurality of Z coordinates of the object. 

1 5. The method of claim 1 wherein step g) further 

2 comprises the steps of: 
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1 7. The method of claim 6 wherein the function of step q 

2 is an averaging function. 

1 8. The method of claim 1 wherein the at least one 

2 second dimension is an edge coordinate of a feature on 

3 the object. 

1 9. The method of claim 1 wherein the at least one 

2 second dimension is a diameter of a feature on the 

3 object . 

1 10. A method for determining at least two dimensions of 

2 an object comprising the steps of: 

3 a) illuminating at least a portion of the object at 

4 a predetermined X-Y coordinate with ijght transmitted by 

5 a light source along a first path; 

6 b) detecting light reflected along a second path 

7 spaced from the first path from the object at a first 

8 preselected position; 

9 c) forming a first image of the illuminated potion 

10 of the object as a function of the liqhc detected in step 

11 b) ; 

12 d) simultaneously with step b) , detecting light 

13 retro-reflected within the first path from the object at 

14 a second preselected positions- 
IB e) forming a second image of the illuminated portion 

16 of the object as a function of the light detected in step 

17 d; 

18 f) repeating steps a) - e) for a plurality different 

19 portions of the object at respective X-Y coordinates 

20 thereby forming a plurality of first respective images 

21 and a plurality of second respective images; 

22 g) determining at least one first dimension of the 

23 object as a function of each of the plurality of first 

24 respective images; and 
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1 14 . A method for determining at least one dimension of 

2 an object comprising the steps of: 

3 a) obtaining a plurality of intensity values, the 

4 plurality of intensity values related to a sample object; 

5 b) determining a first cluster center as a function 

6 of the plurality of intensity values; 

7 c) determining first and second associated cluster 

8 centers, each a function of the first cluster center; 

9 d) associating a first subset of the plurality of 

10 intensity values with the first associated cluster 

11 center; 

12 e) associating a second subset of the plurality of 

13 intensity values with the second associated cluster 

14 center, wherein the second subset is different than the 

15 first subset; 

16 f) updating the first associated cluster center as a 

17 function of the first subset; 

18 g} updating the second associated cluster center as 

19 a function of the second subset; 

20 h) repeating steps e-g until the first associated 

21 cluster center and the second associated cluster center 

22 converge; and 

23 i) determining a threshold value as a function of 

24 converged first associated cluster center and second 
•25 associated cluster center; 

26 j) illuminating at least a portion of the object 

27 with light transmitted by a light source along a first 

28 path; 

29 k) detecting light retro-reflected within the first 

30 path from the object at a preselected position; 

31 1} forming a second image of the illuminated portion 

32 of the object as a function of the light detected in step 

33 d; and 

34 m) determining at least one dimension of the object 

35 as a function of the first image and the threshold value. 
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20. The system of claim 15 wherein the second photo 
sensitive device is a photo diode array. 

21. The system of claim 15 further comprising: 
a third photo sensitive device ac a third 

preselected position for detecting light reflected along 
a third path spaced from the first and second paths from 
the object and for generating a third signal representing 
information concerning the light detected along the third 
path; and 

wherein the processing means is in communication 
wich the third photo sensitive device and receives the 
third signal and generates a third image of the at least 
a portion of the object as a function oi the third 
signal . 

22. The system of claim 21 further comprising: 

a fourth photo sensitive device at a fourth 
preselected position for detecting light transmitted from 
the light source along the first path and for generating 
a fourth signal representing information concerning the 
transmitted light; and 

wherein the processing means is in communication 
with the fourth photo sensitive device and receives the 
fourth signal and processes the second signal as a 
function of the fourth signal. 

23. An optical measurement system comprising; 

a light source positioned to transmit light along a 
first path for illuminating at least a portion of the 
object ; 

a first photo sensitive device at a first 
preselected position for detecting light reflected along 
a second path spaced from the first path from the object 
and for generating a first signal representing 
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18 information concerning the light detected along the first 

19 path; 

20 processing means, in communication with the first 

21 and second photo sensitive devices, for receiving the 

22 first signal and for generating a first image of the at 

23 least a portion of the object as a function of the 

24 received first signal, and for receiving the second 

25 signal and for generating a second image of the at least 

26 a portion of the object as a function of the received 

27 second signal, the processing further for determining at 

28 leasr one dimension of the object based on the first 

29 image and ac leasr one second dimension of the object 

30 based on the second image. 

1 25. The system of claim 24 wherein the deflector 

2 includes an acousto-opt ic deflector. 
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MO = M+p 
Ml = M-p 
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l(i.j) = 0 IF 0(Y(i.j).MO) < D(Y(i.j).MI) y^OA 
l(l.j) I IF D(Y(i.jKMO) > D(Y(i.j).Ml) 



MO = 1/N0*2:Y{i.j) FOR l(i.j)=0 
M 

WHERE NO IS THE TOTAL NUMBER 
OF DATA POINTS WHERE l(i.j) = 0 

Ml ' 1/Nl FOR l{i.j)=l 

i.j 

WHERE Nl IS THE TOTAL NUMBER 
OF DATA POINTS WHERE l(i,j) = t 
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FIG. 8 
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